On Elliptic Genera and Foliations 



Kefeng Liu,[] Xiaonan MaQ and Weiping ZhangP] 

Abstract. We prove several vanishing theorems for a class of generalized elliptic genera on 
foliated manifolds, by using classical equivariant index theory. The main techniques are the use of 
the Jacobi theta-functions and the construction of a new class of elliptic operators associated to 
foliations. 

§1. Introduction 

The main purpose of this paper is to prove some vanishing theorems of characteristic 
numbers for foliated manifolds with group actions. Such type of results are usually proved 
by using index theorems or fixed point theorems for foliations as developed by Connes, 
Skandalis, Heitsch, Lazarov and so on (cf. [Co] and [HL1]). In this paper we take a rather 
different route. Instead of using the heavy machinery about index theory for foliations as 
developed by various people, we use certain new elliptic operators particularly designed to 
study integrable subbundles with spin struture, the so-called sub-Dirac operator. With the 
help of such operators, we are able to prove our theorems for foliated manifolds by using 
the classical index theory (Compare with [HL2]). Such operators are also used in [LiuZ] to 
prove certain vanishing theorem for characteristic numbers of foliations with spin leaves of 
positive scalar curvature, which were previously proved by Connes (cf. [Co, pp. 182 and 
270]) by using noncommutative index theory. 

More precisely, let (M, F) be a transversally oriented compact foliated manifold such 
that the integrable bundle F is spin and carries a fixed spin structure. Assume that there 
is an effective S 3 -action on M which preserves the leaves induced by F and also the spin 
structure on F. Then a special case of our result shows that the Witten genus ([W, (17)]) 
of M vanishes if the first Pontryagin class of F verifies Pi{F) = 0. Note that here we do 
not assume that the manifold M is spin, so that the Witten genus under consideration in 
general might not be an integer. 

On the other hand, we will also prove certain vanishing theorems for spin manifolds with 
split tangent bundles, by using the similar technique. The elliptic genera we derive in this 
situation can be viewed as interpolations between the various classical elliptic genera. They 
are actually the mixture of the two universal elliptic genera. It is interesting to note that, 
under some mild conditions, we get quite general vanishing theorems. Similar theorems can 
be proved for loop group representations. 

This paper is organized as follows. In Section 2, we introduce the sub-Dirac operator. 
In Section 3, we state our main vanishing theorem for elliptic genus on foliations, which 
will be proved in Section 4 by combining the construction in Section 2 with Jacobi-theta 
functions. In Section 5, we prove several vanishing theorems for certain twisted elliptic 
genera associated to spin manifolds with split tangent bundle. In Section 6, we point out 
other generalizations and state a conjecture concerning the vanishing of the Witten genus of 
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a foliation with spin leaves of positive Ricci curvature. 
§2. Sub-Dirac operator 

Let M be an even dimensional smooth compact oriented manifold. Let F be a sub-bundle 
of the tangent vector bundle TM of M. Let g™ be a Riemannian metric on TM. Let F 1 - 
be the orthogonal complement to F in TM. Then one has the orthogonal splittings 

TM = F®F ± , 

9™ = 9 F ®g F \ (2.1) 
Moreover, one has the obvious identification that 

TM/F ~ F ± . (2.2) 

From now on we make the special assumption that F is even dimensional, oriented, spin 
and carries a fixed spin structure. Then F 1 - carries an induced orientation. Set 2p = dim F 
and 2r = dimF ± . 

Let S(F) be the bundle of spinors associated to (F, g F ). For any X e F, denote by c(X) 
the Clifford action of X on S(F). We have the splitting 

S(F) = S+(F) © S-(F) (2.3) 

and c(X) exchanges S±(F). 

Let A(F ± '*) be the exterior algebra bundle of F^. Then A(F ± '*) carries a canonically 
induced metric g A ^ F '*-' from g F . By using g F , one has the canonical identification F 1 - ~ 
F" 1 '*. For any U E F ± , let C/* G F" 1 '* be the corresponding dual of U with respect to g F± . 
Now for [/GF 1 , set 

c([/) — JJ* A -i v , c(U) = U* A (2.4) 

where C/*A and i[/ are the exterior and inner multiplications by U* and U on A(F ± '*) 
respectively. One has the following obvious identities, 

c(U)c(V)+c(V)c(U) = -2{U,V) gF ±, 

c(U)c(V) + c(V)c(U) = 2{U,V) gF ±, 

c(U)c(V) + c(V)c(U) = (2.5) 

for U, V e F ± . 

Let hi, ■ ■ ■ , h 2r be an oriented local orthonormal basis of F ± . Set 

r (F\ g F± ) = (V^lYc(hi) ■ ■ ■ c{h 2r ). (2.6) 

Then clearly 

r(F ± ,/ ± ) 2 = Id A(F x,, ) . (2.7) 

Denote 

A± (F^*) = {/i e A (F x '*) : r (V, (? F± ) /i = ±/i} . (2.8) 



Then A±(F- L '*) are sub-bundles of A(F J -'*). Also, one verifies that for any h G F -1 , c(h) 
anticommutes with r, while c{h) commutes with r. Thus c(h) exchanges A±(F ± '*). 
We will view both vector bundles 

S(F) = S+(F)®S-(F) (2.9) 

and 

A (F^*) = A+ (F^*) © A_ (F^*) (2.10) 
as super-vector bundles. Their Z 2 -graded tensor product is given by 

S(F)©A (F x -*) = [S+(F) © A + (F^*) © S_(F) © A_ (F^*)] 

[S-+(F) © A_ (F ± -*) © S_(F) © A + (F^*)] . (2.11) 

For X G F, U G F x , the operators c(X), c(C/) and c(C/) extends naturally to 5(F)©A(F X '*). 

The connections V F , V F lift to 5(F) and A(F ± '*) naturally, and preserve the splittings 
(2.9) and (2.10). We write them as 

V 5(F) = V 5 + (F) V 5_(F) ; V A(F^.*) = yA^*) y A_(F^.*)_ (2J2) 

Then S'(F)©A(F- L '*) carries the induced tensor product connection 

V 5(F)SA(^-) = V 5(F) Ma(f± ^ + H5(f) V A(F^)_ ^ 

And similarly for S±(F)®A±(F- L '*). 

Let 5 G T(T*M © End (TM)) be defined by 

V™ = V F + V F± + 5. (2.14) 

Then for any X G TM, S*(X) exchanges F and F 1 - and is skew-adjoint with respect to g™ . 

For any vector bundle E over M, by an integral polynomial of E we will mean a vector 
bundle <p(E) which is a polynomial in the exterior and symmetric powers of E with integral 
coefficients. 

Let ip(F) (resp. ^(F- 1 )) be an integral polynomial of F (resp. F^), then ip(F) (resp. 
^(F- 1 )) carries a naturally induced metric g^T) (resp. g^ )) from g F (resp. g F ) and 
also a naturally induced Hermitian connection V^ F ) (resp. )) induced from V F (resp. 

V F± ). 

Our main concern will be on the Z 2 -graded vector bundle 

(S(F)©A (F^*)) ©^(F)© V ?(F ± ) (2.15) 

which is 

[S+(F) © A + (F^*) © V(F) © y? (F x ) © S_(F) © A_ (F x '*) © ^(F) © <p (F^)] 

[S+(F) © A_ (F^*) © V(F) © if (F x ) © S + (F) © A_ (F^*) © V(F) © tp (F^)] . 

The Clifford actions c(X), c(U) and c(U) for X G F, U G F- 1 extend further to these 
bundles by acting as identity on ip(F) © ip(F^-). 
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We can also form the tensor product metric on the new bundles as well as the tensor 
product connection on (S(F)§>A(F ± '*)) <g> ip(F) <g> tp{F L ) given by 

V (S(F)§A(i^)) W )^) = V 5(F)§A(F^) W ^ (F) ^ (F±) + Id^,^ ® V^^ X ), 

(2.16) 

where ^^ F )®^ F± ) is the tensor product connection on ip(F) ® v 9 (-^ 1 " L ) obtained from 
and V v(F±) , as well as on the ± subbundles. 

Now let {fi}^=i be an oriented orthonormal basis of F. Recall that {hg} 2 ^ is an oriented 
orthonormal basis of F L . The elliptic operators which are the main concern of this section 
can be defined as follows. It is introduced mainly for the reason that the vector bundle F 1 - 
might well be non-spin. 

Definition 2.1. Let D F ^ F )^ F ±) be the operator which maps T(S(F)®A(F- L '*) <g> 
if>(F) ®(p(F r )) to itself defined by 

2p 2r 

i=l s=l 
2p 2r 2r 2p 

+ 2 £ E h.)c(fWi)<hs) + 2 E mh s )c{h t )c{U). (2.17) 

i,j=l s=l s,t=l 1=1 

It is easy to verify that D F ^ F ^^ F ^ is a first order formally self adjoint elliptic differ- 
ential operator. Furthermore, it anticommutes with the Z 2 grading operator of the super 
vector bundle (S , (F)®A(F J -'*)) <g> ^(F) <8> <^(-F ± ). 

Let £ ) f,^(f)® ¥J (f-L),+ (resp. %(jr)^( f i) r ) be the restriction of £>f,v>(f)®^(f-L) to the even 
(resp. odd) subbundle of (S , (F)®A(F- L -*)) <g> if>(F) <g> </?( F± )- Then one has 

D*F,ip{F)(g)ip{F ^) ,+ = D F,il>(F)® 9 (F±),-- (2-18) 

Remark 2.2. Locally, Af^Of)®^^) may be seen as a twisted Dirac operator. The key 
point here is that its definition relies only on the spin structure of F (Compare with Remark 
4.4 in Section 4). 

The following result follows easily from the Atiyah-Singer index theorem [AS]. 
Theorem 2.3. The following index formula holds, 

ind (D FMmv(F ^ + ) = (!(F)ch(V(F))L (i^) ch (<p (i^)) , [M]} . (2.19) 

Now assume that M admits an ^-action which preserves g™, as well as the spin struc- 
ture on F. Then it also preserves the splittings in (2.1). Furthermore, an equivariant version 
of the index formula (2.19) still holds. 

More precisely, let {N} be the set of connected components of the fixed point set of this 
circle action. Assume that when restricted to the fixed point set, we have the equivariant 
decompositions 

F\ N = F ® (@jEj) , F ± = Fj~ © (fyLj) (2.20) 



4 



such that the generator e 2mt G S* 1 acts trivially on the real vector bundles F and F^~, 
and acts on the complex vector bundles Ej and Lj by multiplications by e 2mmjt and e 2mnjt 
respectively. Let {2mXj} be the Chern roots of Ej and {2irizj} be the Chern roots of Lj. 
(Note that in our notation, if Ej is a complex line bundle and R Ej is the curvature of a 

connection on Ej, then ~^ 3 = 2mXj.) 

By (2.20), F , F 1 - are naturally oreinted. We fixe the orientation on N induced by the 
orientations on Fo, F^. 

The following result follows easily from the equivariant index theorem of Atiyah, Bott, 
Segal and Singer (cf. [AS]). 

Theorem 2.4 The following equivariant index formula for the Lefschetz number of the 
generator g = e 2mt G S 1 associated to the elliptic operator D F M F \ lg)lfi r F ±\ + holds, 

L(g) = J2 (a(F )L (#) A(F,t)L (F L ,t) ch g &(F\ N )) ch g (<p (F^)) , [N]) , (2.21) 

N 

where 

A(F, t) = TT — — — - h --, L(F ± ,t)=Y\ . (2.22) 

v 1 Al 2sinh(7ri(xJ + m j t)) y ' Al tanh(7ra(a;J + rijt)) 

and ch. g denotes the equivariant Chern character, for examples, 

c\{F\ N ) = ch(F ) + e 2 ^ +m ^\ ch 9 (F^n) = ch (Ff) + ^ e 27r ^+"A (2.23) 

j,k j,k 

§3. Elliptic genus for foliations 

For any vector bundle E, let us denote the two operations in X-theory, the total sym- 
metric and exterior power operations, by 

Sym q (E) = l + qE + q 2 Sym 2 (E) + • • • , 

A q (E) — 1 + tE + t 2 A 2 (E) + • • • , (3.1) 
where q is a parameter. Recall the relations: 

Sym^f?! - E 2 ) = Sym^) ■ A„ q (E 2 ); A q (E 1 - E 2 ) = A,(^) • Sym_,(£ 2 ). 

In what follows, we will take ip(F) to be the Witten element [W] 

q q (F) = ®™ =1 Sym qj (F - dimF) (3.2) 

with q a parameter. 

We now further assume in this section that F is a nontrivial integrable sub-bundle of 
TM. Then F induces a foliation on M. We make the basic assumption that the ^-action 
on M preserves the leaves induced by F. 

Recall that the equivariant cohomology group H* sl {M) is defined to be the usual coho- 
mology group of the space ES 1 x s i M, where ES 1 denotes the universal principal S^-bundle 



5 



over the classifying space BS 1 . Here we take co homology with rational coefficients. The 
projection 

7T : ES 1 x s i M -> BS 1 (3.3) 

induces a map 

vr*: H* sl (pt.) ^ H* S1 (M) (3.4) 

which makes Hg 1 (M) a module over ifj^pt.) ~ Q[[u]] with -u a generator of degree 2. 

Let pi(F) s i be the equivariant first Pontryagin class of F. We can now state the main 
result of this section as follows. 

Theorem 3.1. If M is connected and the S 1 -action on M is nontrivial andpi(F) s i = 
n- ir*u 2 for some integer n, then the equivariant index of D F ^ q ^ F ^^ F ±^ + is 0. As a conse- 
quence, for any Pontryagin class p(TM/F) ofTM/F, we have 



A(F)ch (V q (F))p(TM/F), [M]j = 0. (3.5) 
In particular, the Witten genus [W] of M, which is defined by 

(A(TM)ch (f,(TM)) , [M]j , (3.6) 

vanishes. 

If the ^-action is induced from an effective S^-action which also preserves the foliation 
and the spin structure on F, then one can show that pi(F) s i = n • n*u 2 is equivalent to the 
condition that Pi(F) = 0. This gives us the following 

Corollary 3.2. Assume that M is connected and that there is an effective S 3 -action that 
preserves the foliation and the spin structure on F, and that Pi(F) = 0, then the equivariant 
index of D F ^ q( ^ F ^^ F ±^ + is 0. In particular, the vanishing formula (3.5) holds and the 
Witten genus given by (3.6) vanishes. 

Theorem 3.1 and Corollary 3.2 will be proved in the next section. 

§4. Proof of Theorem 3.1 

Let us first recall the defintion of the Jacobi-theta functions as in [Ch]. 
For veC,teH = {tE C, Imr > 0}, q = e 2ntT , let 9(v,t) denote the classical Jacobi 
theta-function 

oo 

e(v, r) = c(g)g 1/8 2sin (ttu) JJ (l - q n e 2mv ) (l - q n e' 2mv ) (4.1) 

n=l 



where c(q) = UZi i 1 - Q n )- Set 

d6(v,T) 



dv 



(4.2) 



v=0 

Since any Pontryagin class piF- 1 -) of F 1 - can be written as a linear combination with 
rational coefficients of classes of the form L(F- L )ch((p(F ± )), we can and we will assume first 
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that pi^F^-) is of homogeneous degree 21 and that ^(-F" 1 ) verifies that L(F J -)ch(y9(F- L )) is a 
nonzero rational multiple of p(F ± ). 

Let g = e 2mt G S 1 be a generator of the ^-action. Let {iV} denote the set of connected 
components of the fixed point set of the S^-action. Since the S^-action preserves the leaves 
induced by F, according to Lemma 3.3 in [HL2], it induces a trivial action on F ± \^. Assume 
that the bundle F\ N has the decomposition 

F\ N = F © (®jEj) , (4.3) 

where each Ej is a complex vector bundle on which e 2mt acts by e 2mmjt , while the S* 1 acts 
trivially on the real vector bundle F . 

Let {2iriXj} denote the Chern roots of Ej, and let {±2niyj} denote the Chern roots of 
Fo <8>r C. By Theorem 2.4 one deduces easily that the Lefschetz number L(g) associated to 
the operator D F ^ q{F) ^ {F ± )j+ is given by 

H(t,r) = (2^)-^(h(F ,t) IJ ^ (x f|° m ^ r) ) L ( F± \n) ^ fa (F±\ N )) , [N]) , 

(4.4) 

where the term H(F ,t) denotes the characteristic class 

Considered as function of (t, r), we can obviously extend H(t, r) to meromorphic function 
on C x H. Note that this function is holomorphic in r. 

Recall that 2p = dimF and that L(F ± )ch(y9(F- L )) is of homogeneous degree 21. As the 
S 1 action on M induces a trivial action on F^n, we know that dim iV = 2r + dimF . 



Lemma 4.1. The following formulas hold under the modular transformations, 

H = r p+r - l e- nint2/T H(t, t), H(t, r + 1) = H(t, r). 

Proof. One deduces easily that the condition on pi(F)gi implies that 



(4.6) 



(27r^ + mjuf + y^(27r^j) 2 = n-u 2 , 

j,k j 

which in turn implies that 

E(4) 2 + E^ 2 = °> E m ^ = °> E( dim c^K = ™- ( 4 - 7 ) 

By [Ch], we have the following transformation formulas 

e(K--)=\\fce*£e(t,T), 6(t,T + l)=e*6(t,T). (4.8) 



By (4.7) and (4.8), we get 

- (2 " ) — ? (n M£$) n (^b) - m * (. • w ; 

(4-9) 

By comparing the (|dimFo + r) = |dimA^ homogeneous terms of the polynomials in 
x's and y's and the Chern roots of F" 1 , on both sides, we get the following equation: 

- ^ n ( ^T^, T) ) L < F± w ch ( F±| -» • m ) ■ (4 - io) 

By (4.9), (4.10), we get the first identity of (4.6). By using (4.8), the second identity can 
also be verified easily. Q.E.D. 

Lemma 4.2. For a, b G 2Z, £/ie following identity holds, 

H{t + aT + b,T)= e ™n(a 2 r+2at) H (^ ^ 

Proof. By [Ch], for a, b G 2Z, we have the transformation formula for the theta-function, 

9(t + ar + b,T) = e m{a2T+2at) 9(t, r). (4.12) 
By using (4.7) and (4.12), we obtain immediately the wanted identity. Q.E.D. 
Let R denote the real number field. 

Lemma 4.3. The function H(t, r) is holomorphic for (t,r) G R x H. 

Remark 4.4. Lemma 4.3 is the place where the spin condition on F comes in, which 
guarantees that the function H(t, r) is defined as the equivariant index of an elliptic operator, 
which is a virtual character of the S 1 representation and therefore is holomorphic for (t, r) G 
R x H. 

Proof of Lemma 4-3. Let z = e 2mt , K = max^m^. Denote by D K C C 2 the domain 

Igl 1 /^ < \z\ < \q\- l/K , < \q\ < 1. 

Let /a? be the contribution of the fixed component N in the function H. Then by (4.1), 
(4.4), in Dk, /jv has expansion of the form 



oo 



H(i-z^y p(p+r) J2 b ^h n , 



n=0 
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where T l ^ =0 bN,n(z)q n is a holomorphic function of (z,q) E Dk, and bN, n (z) are polynomial 
functions of z. So as a meromorphic function, in Dk, H has an expansion of the form 

oo 

X>(*)? n 

n=0 

with each & n (z) a rational function of z, which can only have poles on the unit circle {z : 
\z\ = l}. 

Now if we multiply the function if by a function of the form 

/w=nri( i -^) p(p+r) ' 

N j 

where N runs over the connected components of the fixed point set, we get a holomorphic 
function which has convergent power series expansion of the form 



n=0 

with {c n (z)} polynomial functions of z in Dk- 

By comparing the above two expansions, we get 

c n (z) = f(z)b n (z). 

On the other hand, we can expand the element ^ q (F) <g> ^{F^) into formal power series 
of the form Z™ =0 R n q n with R n E K(M). So, for t E [0, 1] \ Q, z = e 2nit , by applying the 
equivariant index formula to each term we get a formal power series of q for H: 

oo / JV(n) 

E E a rn,nZ m \r 

n=0 \m=-N(n) 

with a m ,n £ C and N(n) some positive integer depending on n. 

By comparing the above formulas we get for t E [0, 1] \ Q, z — e 



2nit 



N(n) 
m=-N(n) 



bn(z) = E a m,r,~ V ' 



Since both sides are analytic functions of z, this equality holds for any z E C. 
By using the Weierstrass preparation theorem, we then deduce that 



OO oo 

EM^ n = 77^E c ^" 



ra=0 J v ' n=0 

is holomorphic on (z, q) in D K which clearly contains the set {(t,q) : t E~R,q E H}. Q.E.D. 
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We recall that a (meromorphic) Jacobi form of index m and weight k over LxT, where L is 
an integral lattice in the complex plane C preserved by the modular subgroup T C SL{2, Z), 
is a (meromorphic) function F(t, r) on C x H such that 



t ar + b 



(cT + d) k e 2mm{ct2/{cT+d)) F(t,r), 



cr + d cr + d / 

F (t + Ar + /I, r) = e -2«i"»(A 2 r+2At) F ( f> r ) ) (4.13) 

where (A, |i)eL and 7 = ^ ° ^ ^ G T. If F is holomorphic on C x H, we say that F is a 
holomorphic Jacobi form [EZ]. 

Lemma 4.5. The function H(t, r) is a holomorphic Jacobi form of weight p + r — I and 
index -n/2 over (2Z) 2 x SX(2,Z). 

Proof. For 7 = ^ ° ^ ^ G SL(2, Z), we define its modular transformation on C x H 

by 

/ £ ar + 6 
ycr + a cr + d y 

Recall the two generators of SL{2, Z) are S = ^ ^ J" ^ and T = ^ J 1 ) ' w ^^ c ^ ac ^ 
on C x H in the following way: 

S(£,r) = T(f,r) = (f,r + 1). 

So Lemmas 4.1-4.3 imply that H(t, r) is a (meromorphic) Jacobi form of weight p + r — I 
and index —n/2 over (2Z) 2 x SL(2, Z). We now show that it actually is holomorphic. 
From (4.1) and (4.4) we know that the possible poles of H in C x H are of the form 

t =\cT + d), (4.14) 
s 

where h, s, c, d are integers with (c, d) — 1 or c = 1, d — 0. 

We can always find integers a, b such that ad — be = 1. Then the matrix 

7=(l c ~ 6 ) eSL(2,Z) (4.15) 

induces an action 

H(l(t, r)) = H ( —L- , Ali) . (4.I6) 
\ — cr + a — cr + a/ 

Now, if t = -j(cr + d) is a polar divisor of if (£, r), then one polar divisor of if (7(£, r)) is 
given by 

t h ( dr — b \ . , ^ 

- c + d , (4.17) 



-cr + a s \ — cr + a 
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which exactly gives t = h/s. But by Lemma 4.1, up to a factor that is holomorphic in 
(t,r) G C x H, H(^(t, t)) is still equal to H(t,r) which is holomorphic for t G R. This 
implies that H(t,r) has no poles in C x H. Q.E.D. 

Proof of Theorem 3.1. Since by (4.7), n = Ylji^^cE^m 2 , we have n > 0. 

(i) If n — 0, then since the S^-action is nontrivial, it has no fixed point on M. Thus all 
the Lefschetz number L(g) vanishes by the fixed point formula. 

(ii) If n > 0, then Lemma 4.5 shows that H(t, r) is a holomorphic Jacobi form of negative 
index. By [EZ, Theorem 1.2], H(t,r) must be zero. 

By (i), (ii) and our choice of (p(F L ), one gets (3.5) easily. Formula (3.6) then follows 
from (3.5) and the multiplicativity of the Witten elements: 

f ? (TM)=f 9 (F).f (( (F 1 ). (4.18) 

Now for a general ^{F^), we write 

L (F x ) ch (<p (F 1 -)) =J2 u i ( F± ) with ^ ( F± ) G Hi ( M > Q)- ( 419 ) 

i 

Then for each ^(F- 1 ), one can find an integral polynomial (f^F- 1 ) such that 

L (F x ) ch = n, • Ui (4.20) 

for some nonzero integer n^. One then verifies that the equivariant index of i^F,*,^)®^^ 1 ) 
can be expressed as a linear combination with rational coefficients of the equivariant indices 
of D F ^ q ( F ^ tp .( F ±j , s, which have been proved to be zero. 
The proof of Theorem 3.1 is completed. Q.E.D. 

Proof of Corollary 3.2. We can either use the simple exact sequence for the «S 3 -equivariant 
cohomology groups, 

H 4 (BS 3 ) -> H% i (M) -> H\M) (4.21) 
which follows from the spectral sequence for the fibration 

ES 3 x 5 3 M -> BS 3 

by using the fact that BS 3 is 3-connected. Here ES 3 is the universal 5' 3 -principal bundle 
over the classifying space BS 3 of S* 3 . 

Alternatively, one may prove this by using the following simple observation. In fact, at 
least formally, we may write pi(F) s i as 

p 1 (F) S i =Pi(F) +Au + n-ir*u 2 (4.22) 

with A a two form on M. 

If the S^-action is induced from an S^-action, then pi(F)si should be invariant under 
the Weyl group action u — > —u, which implies A = 0. 

This means under the condition of Corollary 3.2, there exists n G Z, such that ^1(^)51 = 
nn*u 2 . By Theorem 3.1, we get Corollary 3.2. Q.E.D. 
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By using a special case of the above arguments, one gets the following result in which 
the condition on pi(F) is no longer needed (Compare with [HL1, Prop. 3.2]). It generalizes 
the classical Atiyah-Hirzebruch vanishing theorem [AH] to the foliated manifolds. 

Theorem 4.6. If S 1 - acts effectively on a compact connected foliation (M,F) and pre- 
serves the leaves induced by F as well as the spin structure on F , then (A(TM), [M]) = 0. 

§5. Manifolds with split tangent bundle 

In this section, we no longer assume that F is integrable. We assume instead that M 
itself is a spin manifold and the ^-action preserves the spin structures on TM and F. Then 
it also preserves the induced spin structure on TM/F ~ F ± . Consequently, the ^-action 
on the restriction of F ± to the fixed point set of the S^-action on M need not be trivial. 

Let us introduce elements 

R q {F L ) = ®°° =1 Sym qj (F 1 - - dimi^) <g> (®™ =1 A q m (F 1 - - dimi^)) , 

R' q (F 1 -) = ®°° =1 Sym qj (F ± - dimi^) <g> (®™ =1 A qm -i,2 (F ± - dimF^) , 
K {F L ) = ®£iSynv (F ± - dimi^) ® {®™ =1 A_ qm -i /2 {F ± - dimi^)) . (5.1) 
Recall that since the ^-action preserves g™ , it preserves the orthogonal splitting 

TM = F © F ± . (5.2) 

Let D denote the canonical Dirac operator on M associated to g™. We also consider 
the twisted Dirac operators 

D* q{ F)<S>R' q (F^=D ®K (^) 

and 

D * q (F)®R»(F-) = D ® W ® K ( F± ) ■ 

Under the above assumptions and notations, the main result of this section can be stated 
as follows. 

Theorem 5.1. If pi(F) s i = n ■ n*u 2 for some integer n ^ 0, then the equivariant 
indices of D F ^ q{F)mq{F r )t+ , D^ q{F) ^ R , q{F ± ):+ and -D* g (F)<g>R»(F-L),+ vanish. In particular, the 
following three formulas hold, 

(A(F)L {F l ) ch(^(F))ch (R q (i^)) , [M]) = 0, 
(l(TM)ch(^(F))ch (R' q (F^) , [M]) = 0, 

(l(TM)ch (* q (F)) ch (i2j (F 1 -)) ,[M\) = 0- (5-3) 
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Proof of Theorem 5.1. Let 

F\ N = F ® {® E 3 ) , F ± \ N = F L © (©^) (5.4) 

be the corresponding equivariant decomopositions of F and F L , when restricted to the 
connected component N of the fixed point set of the ^-action on M. Assume the generator 
g = e 2mt G S 1 acts on Ej by multiplication by e 2mmjt and on Lj by multiplication by e 2mrijt . 

Let {27rix^} denote the Chern roots of Ej and {2-rriZj} denote the Chern roots of Lj. 
We also denote by {±2niyj} and {±2iriwj} the Chern roots of F £g> R C and F^ ® R C 
respectively. 

Let 9i(v,t), 9 2 (v,t) and 9 3 (v,t) be the three theta functions (cf. [Ch]): 

oo oo 

Os(v, r) = c(q) J] (1 + q^e 2 ™) J] (l + q^e' 2 ^) , 

n=l n=l 

oo oo 

Uv, r) = c(q) J] (1 - <T VV 7 ^) J] (1 - ^-V^-^) > 

n=l n=l 

oo oo 

^(u, r) = c(g)g 1/8 2 cosM J] (l + gV™) J] (l + q n e~ 2mv ) . 

n=l n=l 

Let us write 

G (t) = A(F )L (#) ch (* 9 (F )) ch (itf)) , 
G' (r) = A(TN) ch (tf, (F )) ch (R' q (itf)) , 

Gg(r) = A(TN) ch (tt 9 (F )) ch (i2j (itf)) . (5.5) 
By applying the equivariant index formula (2.21), we get three functions, 

-> - h s ^ n mmm- ™ > ■ 

r»( f r\ S-il^v+r-^) l r n ( , TT 0'(O,r) ^ g 3 (4 + V,rM0,r) 

(5.6) 

corresponding to the equivariant indices of the three elliptic operators D F ^ q ( F ^ R ( F ±^ + , 
Dq, q ( F )®R>(F^),+ and D q , q{F)(g)R „ {F ± )y+ respectively. 

Now recall the definitions of the following three modular subgroups: 

r (2) = <j ( a b ) G SL{2, Z) : c = (mod 2) 

I V C 0j I 




r°(2) = <j I " v J G SX(2, Z) : 6 = (mod 2) 
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By using the modular transformation formula of the theta- functions [Ch] , we can imme- 
diately prove the following result by proceeding as in the proofs of Lemmas 4.1 and 4.2. 

Lemma 5.2. If pi(F) s i = n ■ n*u 2 , then G(t,r) is a Jacobi form over (2Z) x r (2) 7 
G'(t, r) is a Jacobi form over (2Z) x r°(2) and G"{t, r) is a Jacobi form over (2Z) x T e . All 
of them are of index — n/2 and weight p + r. 

For 7 = ^ ° ^ ^ G SL{2, Z), let us use the notation 

H M t, r))U - + «0-«-"-«^ f^) (5.7) 

to denote the action of 7 on a Jacobi form H of index m and weight k. 

Recall that 2p = dimF and 2r = dimF -1 . The following lemma can be proved easily by 
proceeding as the proof of Lemma 4.3. 

Lemma 5.3. For any 7 G SL(2,Z), let F(t,r) be one of the functions G(t,r), G'(t,r) 
and G"(t, r). Then F(j(t, , p+r is holomorphic for (t, r) G R x H. 

Again this is the place where the index theory comes in to cancel part of the poles of 
these functions. Here the spin conditions on F, TM are crucially needed. 
Now, by using the same argument as in the proof of Lemma 4.5, we get 

Lemma 5.4. For a (meromorphic) Jacobi form H(t,r) of index m and weight k over 
L x T 7 assume that H may only have polar divisors of the form t = (cr + d)/l in C x H for 
some integers c,d and I 7^ 0. If H{j{t,T))\ mtk is holomorphic for t G R ; r G H for every 
7 G SL(2, Z), then H(t, r) is holomorphic for any t G C and r G H. 

From Lemmas 5.3 and 5.4 one sees, as in the proof of Theorem 3.1, that the G's are 
holomorphic Jacobi forms of index —n/2, and therefore must be zero. (Here we have used 
the fact that n > 0.) 

The proof of Theorem 5.1 is completed. Q.E.D. 

Remark 5.5. If n — 0, then we get the rigidity properties in Theorem 5.1 instead of the 
vanishing results. 

§6. Concluding remarks. 

Motivitate by Corollary 3.2, we find it is interesting and reasonable to make the following 
conjecture which may be viewed as a foliation analogue of a conjecture of Hoehn and Stolz 
[S]- 

We consider an oriented compact foliation M which is foliated by a spin integrable 
subbundle F of TM. Let g F be a metric on F . 

Conjecture 6.1. Ifjp±(F) = 0, and the Ricci curvature of g F along each leaf is positive, 
then the Witten genus of M , (A(TM)ch(^ q (TM)),[M}) , vanishes. 

As have been remarked in the introduction, we may as well take ip(F) or ^{F^) in Section 
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2 as the elements in K(M) induced from loop group representations. Then the modularity 
of the characters of the loop group representations can be used to prove vanishing theorems 
for the correponding twisted sub-Dirac operators. On the other hand, the construction of 
the sub-elliptic operators is very flexible. For example if the the integrable subbundle of 
the foliation has almost complex structure or Spin c -structure, then we can construct sub 
(9-operator or Spin c sub-Dirac operator correspondingly. If there exists a compact Lie group 
action on M preserving the leaves, the the rigidity and vanishing theorems can be proved 
for the equivariant indices of such operators which generalize the corresponding rigidity and 
vanishing results for the usual elliptic genera. See [Liu2] or [LiuMa2] for some details about 
these. 

In concluding, we may also replace the signature operator in the normal direction by other 
elliptic operators like the de Rham type operator from which we can derive the vanishing of 
characteristic numbers like 

(A(TM) ch(^(F))e(F ± ),[M]}, 
where e(F ± ) denotes the Euler class of F ± . 
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